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S (57) Abstract: An automatic teleconferencing control system uses a trigger definition database to define trigger criteria and corre- 
sponding conference control commands for corresponding trigger functions. Trigger criteria may relate to configuration profiles set 

O for each participant (1 10-160) or to conference level policy decisions. Participant attribute changes and media flows (411) among 
participant stations (1 10-160) on a conference are analyzed in accordance with the trigger criteria, and when trigger criteria are iden- 

^ tified a corresponding conference command is issued. 
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AUTOMATIC TELECONFERENCING CONTROL 

SYSTEM 



DESCRIPTION 



BACKGROUND OF THE INVENTION 

5 This patent application is a continuation in part of U.S. patent 

application 09/xxx,xxx entitled "Teleconferencing Bridge with Edgepoint 
Mixing" filed on May 15, 2000, and also claims priority from: U.S. 
provisional application 60/139,616 of the same title as the present 
application filed on June 17, 1999; and related U.S. provisional application 
10 60/135,239 entitled "Teleconferencing Bridge With Edgepoint Mixing" 
filed on May 21, 1999. The disclosures of the foregoing applications are 
incorporated herein by reference as if set forth in full text. 

Field of the Invention 

The present invention relates generally to communication systems, 
1 5 and, more particularly, to controlling a media conference arrangement 
through a distributed automatic control network. 

Background Description 



20 



In a communication network, it is desirable to provide conference 
arrangements whereby many customers can be bridged together on a media 
conference connection. A conference bridge is a device or system which 



allows several connection endpoints to be connected together to establish a 
communications conference. Communications conferences may include 
voice, video, and an assortment of other media streams. 

Historically, each conferee in a dial-up conference arrangement is 
summoned at the appropriate time by establishing a communication path to 
the conferee's customer station. The conferee is informed that he or she is 
wanted for a conference call and then added to the bridge where the conferee 
can talk with the other conferees on the bridge. This type of an arrangement 
is under the control and supervision of an operator or attendant. The 
attendant can answer, add or disconnect individual conferees to the bridge 
with minimal interference to the other conferees connected. More recently, 
systems have allowed conferees to enter and leave a conference without a 
physical attendant's participation. 

In the prior art, control of conference bridge operator functions such 
as deleting or intercepting a conferee was accomplished via manual 
operation via a console, which therefore restricted the implementation of 
optional functions to operations manually selectable by a human attendant 
operator. A need therefore exists to be able to create a virtual attendant with 
the ability to perform a multitude of operations without human cost or 
intervention. 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to provide a 
conference bridge which performs optional functions automatically. 

Another object of the invention is to provide a mechanism for pre- 
defining optional functions to be undertaken with respect to individual 
conference participants. 

It is also an object of the invention to provide a mechanism for 
automatically invoking optional functions, based upon attributes set by a 



participant or upon content analysis of media flows distributed on a 
conference. 

It is a further object of the invention to provide an automatic bridge 
controller which is extensible and scalable. 

The invention automatically controls a teleconference by establishing 
a trigger definition database in accordance with participant profiles set up 
for each participant station. Participant stations are connected to a 
teleconference through a media bridge, and media flows originating from a 
participant station are distributed to other participants through the media 
bridge. Media flows (including changes in participant attributes, virtual 
positioning information, audio streams, etc.) are analyzed to determine 
whether trigger criteria defined in the trigger definition database are met. In 
identifying trigger criteria, a media flow is associated with a participant 
station and the trigger definition database is used to determine which trigger 
criteria are applicable to the participant station. When a trigger criteria is 
determined to have been met, a corresponding conference control command 
stored in the trigger definition database is issued, which executes an optional 
function without intervention of a human conference attendant. 

The invention provides automatic control of conference bridges, 
enabling operator functions such as deleting or re-routing a conference 
attendee to occur based on pre-defined trigger criteria. These triggers may 
include ~ but are not restricted to analysis of data content or context, 
receipt of participant-initiated conference controls or requests, or external 
conferencing policy decisions applicable to participant media streams. The 
invention, called the automatic bridge controller, including a trigger 
definition database, which preferably includes trigger functions, trigger 
criteria, and trigger control commands for describing the nature of the 
trigger to be detected as well as the action to be taken; a bridge analyzer, 
which performs the trigger functions, detects trigger criteria, and issues 
trigger control commands; and a bridge control protocol, in accordance with 



which the control commands are sent to the desired system element or 
elements. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, aspects and advantages will be 
better understood from the following detailed description of a preferred 
embodiment of the invention with reference to the drawings, in which: 

Figure 1 shows a reference block diagram of generic bridged 
network with communications endpoints, media flows, conference bridging 
units, and an operator control console; 

Figure 2 shows a block diagram of an automatic multiple bridge 
conferencing environment, with communications endpoints, media flows, 
conference bridging units, an operator control console, automatic bridge 
controllers, and automatic bridge controller control flows; 

Figure 3 shows a detailed block diagram of an automatic bridge 
controller of the present invention, with a separate trigger definition 
database, bridge analyzer, and controller control protocol; 

Figure 3 A shows an exemplary embodiment of a trigger definition 
database according to the present invention, including trigger functions, 
trigger criteria, and trigger control commands; 

Figure 4 shows an example of the operational flow of a bridge 
analyzer according to the present invention, utilizing speech recognition and 
keyword trigger criteria; 

Figure 5 shows an example of the operational flow of a bridge 
analyzer according to the present invention, utilizing collision detection and 
collision triggers; 

Figure 6 shows an example of the operational flow of a bridge 
analyzer according to the present invention, utilizing attribute monitoring 
and attribute triggers; 



Figure 7 shows a distributed automatic bridge controller 
environment, with communications endpoints, conference bridges, and with 
automatic bridge controllers located both within the conference bridge and 
externally, and with bridge analyzers located both within an automatic 
bridge controller and externally, including embedded within the 
communications endpoint client and independently on the network; 

Figure 8 shows an example of distributed bridge analyzer 
functionality, with communications endpoints, a conference bridge, and with 
bridge analyzer functions distributed both within a communications 
endpoint and independently on the network; and 

Figure 9 is a matrix display of example sets of trigger functions, 
trigger criteria and trigger control commands contained in a trigger 
definition database in accordance with the present invention. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT OF THE INVENTION 

Referring now to the drawings, and more particularly to Figure 1, 
there is shown the general organization of a system used for multi-party 
conferencing on a network. A number of conference participant stations, A 
110, B 120, C 130, D 140, E 150, and F 160, are interfaced with conference 
bridging units 210 and 220. This is accomplished by standard conferencing 
multiplexing, or by the improved mechanisms described in related U.S. 
application 09/xxx,xxx entitled "Teleconferencing Bridge with Edgepoint 
Mixing" previously incorporated herein by reference. The operator control 
console 310 is used to perform basic operations which control the 
conferences, including monitoring (passively participating) in a conference, 
manually connecting participant stations, manually deleting participant 
stations, and inquiring as to the status of each conference bridging unit. The 
media interface between the conference participant stations and the 



conference bridging unit may be over the public switched telephone network 
(PSTN), a packet switched network, or a combination of the two in which a 
PSTN to packet switched network gateway is traversed. It will be apparent 
to those skilled in the art that the participant stations may be connected to 
the conference bridging units via any suitable connection, including any 
wide area network, local area network, hard-switched networks, private 
communications networks, cellular networks, etc. 

Figure 2 illustrates, in a block diagram, the general organization of a system 
employing the present invention. In this embodiment, a number of 
conference participant stations, A 1 10, B 120, C 130, D 140, E 150, F 160, 
etc. are interfaced with conference bridging units 210 and 220 by media 
connections. In this embodiment, each conference bridging unit 210, 220 
has associated with it a media bridge 430, 440, and an automatic bridge 
controller 410, 420, which is capable of examining the media flows from 
conference participant stations and taking action by employing a control 
protocol, represented in Figure 2 with control flows. Additionally, the 
operator control console 310 may be employed to manage the automatic 
bridge controllers 410, 420, and permit optional manual remote operation of 
critical bridge conferencing functions. 

Preferably, the operator control console 310, conference bridging 
units 210, 220, automatic bridge controllers 410, 420, and media bridges 
430, 440, are all software functions operating on appropriate hardware, such 
as a DSP platform or an Intel-based personal computer. In one embodiment, 
the conference bridging units are implemented as part of a system control 
unit as described in related U.S. Application 09/xxx,xxx entitled 
"Teleconferencing Bridge with Edgepoint Mixing." In this embodiment, the 
media bridges 430, 440 are implemented as audio bridging units as 
described in that Application, and the conference bridging units 210, 220 are 
implemented as part of the audio-conference bridging system described 
therein. 
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Basic operation of the system in a preferred embodiment is as 
follows. Conference participant stations 110, 120, and 130 independently 
establish a control session with a first conference bridging unit 210. 
Conference participant stations 140, 150, and 160 independently establish a 
5 control session with a second conference bridging unit 220. More or fewer 
conference bridging units can, of course, be employed if desired. The 
conference bridging units 210, 220, then connect the participant stations 
1 10, 120, 130 in a first conference and participant stations 140, 150, and 160 
in a second conference through their respective media bridges 430, 440. 

10 Once a participant station joins a conference, the media flows from that 

participant, and preferably all conference participants, are examined by the 
corresponding automatic bridge controller 410 or 420 to effect appropriate 
trigger functions. As will be discussed, trigger functions are dictated by the 
trigger control database. The management of the automatic bridge 

1 5 controllers 410, 420 in the network is performed by the operator control 
console 310, which maintains and distributes a master trigger definition 
database. Detailed examples of a trigger definition database, trigger 
functions, trigger criteria, and trigger control commands follow in 
subsequent figure descriptions, along with example distributed 

20 configurations of automatic bridge controllers and their sub-functions. 

Figure 3 illustrates the sub-components of an automatic bridge 
controller 410. Media flows 41 1 from conference participant stations are 
examined and tested by a bridge analyzer 412 according to conditions 
established in the trigger definition database 413. As discussed, the trigger 

25 definition database may be maintained on the operator console 3 1 0 and 
simply downloaded as needed to particular conference bridging units as 
needed or may be completely distributed among conference bridging units. 
Specific example sets showing how triggering is accomplished at bridge 
analyzer 412 are described below in connection with Figures 4-6. If a 

30 trigger function is implemented, and trigger criteria established in trigger 
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definition database 413 are met, trigger control commands are issued in 
accordance with control protocol 414 by signaling the appropriate command 
to the devices indicated in the database 413. 

The sub-components and functions of the automatic bridge controller 

410 are described below. Bridge controller 410 may be shared or 
distributed, as described in Figure 7. The sub-components of an automatic 
bridge controller 410 may in turn be distributed, as described in Figure 8. 
Each participant station in a conference is assigned to a corresponding 
automatic bridge controller 410, 420, etc. , although many participant 
stations may be assigned to a single bridge controller. 

In packet-switched conference environments, the media flow 41 1 
can comprise embedded information of any data type. For example, audio 
packets may provide voice information for the conference. Video packets 
may provide video information. Other data packets may provide additional 
information, such as sub-application data (for example, collaborative 
document coordination information), or control information (such as shared 
display cursor information or virtual environment coordinate data). 

In dedicated-switched voice conferencing systems, the media flow 

41 1 may comprise audio information. Even in dedicated-switched 
environments, this audio information may be augmented by a separate 
communication channel of data, employed as described above in packet 
environments. These disparate flows can be coordinated through user 
selection of keys at conference initiation. For example, a user may proceed 
to a conference web site in order to obtain a conference ID and connection 
telephone number, after which point the user connects independently to the 
audio portion of the conference. This procedure is explained in greater 
detail in related U.S. Application No. 09/xxx,xxx, entitled "Teleconference 
Bridge with Edgepoint Mixing," previously incorporated by reference 
herein. The participant preferably answers questions and provides a variety 
of information during the process of obtaining a conference ID, in 



accordance with the particular capabilities of the conference environment 
and requirements for implementing applicable triggers and control protocols 
specified in the trigger definition database. The automatic bridge controller 
thus obtains enough information from this process of obtaining a conference 
ID to coordinate the association of voice and other data in the conference. 

The bridge analyzer 412 performs trigger ftmctions to determine if 
trigger criteria are met and corresponding trigger control commands must be 
executed. The bridge analyzer can comprise a variety of trigger functions, 
depending on the current needs of the trigger definition database, described 
below. In a preferred embodiment, these functions are real-time programs 
which operate continuously on the input media flow or flows from one or 
more of the participant stations. However, some trigger fiinctions may 
require only non real-time analysis, in which case computational resources 
may be employed during off-peak periods, reducing peak computational 
requirements and cost. 

The trigger definition database 413 contains the information 
necessary to link tests on the participant stations' media flows to trigger 
control commands. The database is preferably optimized for real time 
analysis, minimizing and encoding test and action information. For 
example, bit-fields or bit- vectors are employed if implementation hardware 
can take advantage of them, and abbreviated phoneme codes may be stored 
to accelerate comparisons within speech recognition functions, and so on. 
The optimal form of the database will change as the functions needed are 
expanded, with corresponding optimized data entries. 

Examples of sample trigger functions and their corresponding tests 
are shown in Figures 4-6, with reference back to the automatic bridge 
controller functions shown in Figure 3. Each participant may have a 
configuration profile which allows custom application of bridge analyzer 
functions, or applies only a subset of functions to that participant's media 
flow. These configuration files may be stored in a central repository, or 
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encrypted and stored on the participant client device. In each case, the 
participant profile is communicated at the initiation of a session to the 
corresponding automatic bridge controller, and is temporarily linked via the 
trigger definition database to participant option field settings, allowing 
testing of particular functions for each participant. 

The bridge control protocol 414 is used to communicate commands 
to various system components. The type and nature of these commands will 
change as the functions required by the bridge analyzer change. In general, 
the protocol comprises operation codes and data for execution commands on 
the appropriate network element. For instance if a participant (e.g. 
Participant B in Figure 2) needs to be re-routed to a new conference bridge, 
this information will be conveyed via the bridge control protocol 414 to the 
old conference bridging unit (e.g. 210 in Figure 2), the new conference 
bridging unit (e.g. 220 in Figure 2), and the participant's client (e.g. 120 in 
Figure 2), allowing re-connection of the participant station's media flow 
(e.g. 252 in Figure 2) to the new conference bridging unit, as well as 
execution of appropriate participant interface actions such as rerouting the 
participant station to a new conference. Rerouting may involve, for example, 
the bridge analyzer 412 sending trigger control commands to its associated 
media bridge 410 to disconnect participant station B 120; to automatic 
bridge controller 420 to accept media from participant station B 120 through 
its associated media bridge 440; and to participant station B 120, instructing 
participant station B 120 now to send its packets to conference bridging unit 
220. 

Examples of functions operable through the bridge analyzer 413 are 
shown in Figures 4 through 6. Figure 4 shows an example operational flow 
for the automatic bridge controller 410. In this example, the trigger function 
to be performed on participant media flow 41 1 is speech recognition. The 
bridge controller 410 will pass media flow 41 1 to a speech recognition 
function, which may be implemented with, for example, IBM's ViaVoice 
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technology as part of bridge analyzer 412. It may be advantageous in terms 
of efficient use of available resources across the system to distribute 
performance of this speech recognition function to the participant station 
(e.g., participant B 120 in Figure 1) rather than execute the function at the 
automatic bridge controller 410. When words or sentences are extracted, 
they are tested against trigger criteria. In example A, the trigger criteria are 
a list of obscene or age-inappropriate words. The trigger control commands 
in this example comprise allowing the user to be redirected to an appropriate 
conference, sent to customer service, or notified and deleted from the 
conference, depending on the configuration of the trigger database and/or 
that participant station's profile. 

In example B, the trigger criteria are various user help request 
phrases. When these phrases are matched, the bridge analyzer 412 issues 
trigger control commands to cause routing of the participant to the 
appropriate help desk. In example C, e-commerce related routing may 
occur, allowing context-sensitive or command-driven analysis to link the 
user with the appropriate new conference. The control commands are 
preferably communicated via the bridge control protocol 414, and may 
include, inter alia, the variety of information described above in connection 
with Figures 3 and 3A. 

Figure 5 shows another example operational flow for the automatic 
bridge controller 410. In this example, the trigger function to be performed 
on media flow 41 1 from the various participant stations is collision 
detection. To initialize this trigger function for handling by the bridge 
analyzer 412, appropriate entries are made in trigger definition database 413, 
either at system configuration or at a later time when the trigger function is 
identified to bridge analyzer 412 by a participant station (through its profile 
or directly). Collision detection is usually associated with objects in virtual 
two- or three-dimensional spaces, and entails a topological analysis of near 
proximity objects to determine if they have intersected or collided. In this 
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example, the participants (e.g., A, B, C, etc. are represented in a virtual 
conference world by avatars, and the media flow 41 1 from the participant 
stations may include avatar-positional information and object data. The 
avatar-positional information and/or object data is tested by the collision- 
5 detection function to determine whether trigger criteria have been satisfied. 
In this example, trigger criteria may include the intersection of an avatar 
with another avatar or an object within the virtual conference world. It may 
also include the duration of that intersection and/or the speed with which the 
avatar moved into that intersection. If the trigger criteria are satisfied, then 
1 0 the appropriate control command(s) in the trigger definition database 4 1 3 
is/are issued to the appropriate device(s) via control protocol 414. It will 
be observed that the collision detection function performed by the bridge 
analyzer 412 could be implemented in the participant station, as described 
for another example below in Figure 8. In this case the positional 
1 5 information for other relevant avatars and objects is communicated to the 

participant station (such as through the media bridge 430) and only the result 
of the collision detection is conveyed via the control protocol 414. 

In example A of Figure 5, the participant walks into or "collides" 
with a virtual door object that has been labeled on the participant station's 
20 screen to indicate entry to a Baseball Trivia conference, after which the 
participant station is re-routed to the appropriate conference. The control 
commands can also cause an audible event to occur. For example, in 
example B, the participant station's virtual or avatar hand touches a 
selection option on a virtual CD player in a conference, changing selected 
25 background music. In example C, the participant station's motion in the 
virtual conference room is checked for collisions with other objects or 
conferees, causing an appropriate audio event to be triggered. For example, 
if the participant's avatar just barely brushes against an object, it may trigger 
an audio event, such as a "swish" sound at the participant station. A 
30 collision of greater force, alternatively, may trigger a different audio event, 
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such as an "ooph" or "ouch" sound. In all instances, the insertion of an 
audio event is preferably enabled via Edgepoint mixing, as described in 
related patent application serial number 09/xxx,xxx for Teleconferencing 
Bridge with Edgepoint Mixing. The control command could also be sent via 
the control protocol to the participant station directly for automatic 
generation locally. 

Figure 6 shows an additional type of operational flow that can be 
handled by the automatic bridge controller 400. In the examples shown in 
Figure 6, the trigger function to be performed on user media 41 1 is selected 
by the participant. This selection may occur, for example, by direct 
command or via speech recognition of commands, as previously described 
in connection with Figure 4, or via the control protocol 411, after detection 
of the speech pattern in the user interface of the participant station. In 
example A, the participant has indicated selection of language translation. 
Language translation is a processing intense application, involving speech 
recognition, contextual analysis, and language translation. In this event, the 
trigger control commands may comprise instructions internal to the bridge 
analyzer to translate the participant's incoming or outgoing speech into a 
different language. This serves to demonstrate additional example 
complexity, due to the fact that a network element capable of performing 
language translation would likely have to be temporarily assigned to the 
corresponding automatic bridge control unit and additional participant fees 
determined and assessed. Because of resource constraints, this language 
translation function may be selectively assigned (i.e. performed on incoming 
or outgoing streams for particular participant stations), depending on the 
nature of each participant station's requirements and selections as recorded 
in a participant's profile. 

Example B indicates the participant has selected modification of 
his/her voice in a voice conference (or analogously, modification of video or 
imagery in a video conference), according to certain conditions and 
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requirements. For example, a young female may wish to disguise her gender 
and age to some extent, invoking a modification function on her voice, in 
effect modifying the apparent frequency and pitch of her voice stream within 
her media stream. This might be selectively enabled, presenting different 
apparent voices from her to different participant stations. In example C, the 
participant has requested re-routing based on participant attributes, such as 
age and gender. In the example, the participant would be directed to a 
conference which included other participants having the same or similar 
attributes. 

Figure 7 presents a sample distributed automatic bridge controller 
network environment. It is similar to Figure 2, with the addition of a more 
distributed model for the controllers and their bridge analyzer functions. As 
indicated in Figure 7, multiple participant stations may be associated with 
one or more automatic bridge controllers. The automatic bridge controller 
410 may be identical to the one described in Figure 2. In contrast, automatic 
bridge controller 510 is not directly associated with a media bridge 430, 
allowing it to be implemented as an independent network resource, and 
hence flexibly assigned to participant stations and media flows as needed. 
In some situations, such as voice stream media flows, these external 
automatic bridge controllers 510 are preferably capable of independently 
accessing the media flows, by methods such as sharing an application port 
number in a packet network. The participant station may also be expanded 
to include all or a portion of the automatic bridge controller functionality, as 
shown in 412-A, where the bridge analyzer 4 12- A executes locally. For 
example, if the speech recognition application described in Figure 4 can be 
executed with extra cycles of the local participant station, it may be 
advantageous to distribute that particular function. Similarly, bridge 
analyzer 41 2-B may implement a specialized function associated with a 
controller embedded in a conference bridging unit 410, but on an 
independent network unit. Analogously, analyzer 51 2-B may implement 
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one or more analyzer functions associated with independent controller unit 
,5 1 0. All of the elements illustrated in Figure 7 can be connected across any 
suitable network, including a wide area network, a local area network, a 
packet-switched network, a cellular network, a PCS network, etc. 
5 Figure 8 presents a sample distributed bridge analyzer in more detail, 

demonstrating a situation where it is advantageous to employ multiple 
distributed components. Two participant stations are shown. One consists 
of a "heavy" (i.e. processing capable) participant station that has enough 
excess capacity to implement the speech recognition bridge analyzer 

10 function 412-A described in Figure 4, and discussed further above in Figure 
7. In contrast, the other participant station is "light," or does not have extra 
processing capability, and must have its associated speech recognition 
function executed in a separate bridge analyzer. In the example, the bridge 
analyzer is an independent unit 41 2-B. In this example, both participant 

1 5 stations are still coordinated by the same master automatic bridge controller 
410, which contains the trigger database and executes the control protocol. 
In this case, the two bridge analyzers serve as proxies for the controller's 
analyzer functions. Communication between the controller 410 and the 
distributed analyzers 412-A, 41 2-B occurs via a function-specific protocol, 

20 which in this case communicates information such as the trigger functions 
and trigger criteria to the analyzers, and the match list back from the 
analyzer to the controller. 

Other distributed combinations of the various elements described 
herein for the example or other functions would be similarly considered 

25 obvious to those reasonably practiced in the art of distributed network 

design. Similarly, the inherent scalability of bridge controllers in general 
and the bridge analyzers in particular will be apparent to those practiced in 
the art, due to the modular nature of distributed networking. The optimal 
combination of central and distributed resources can vary depending on a 

30 particular network architecture, and may include considerations of 
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bandwidth, operational support, flexibility, redundancy, and other design 
criteria applicable to a network. 

Figure 9 illustrates an exemplary embodiment of a trigger definition 
database 413. It will be recognized that trigger database 413 may take many 
forms and may be distributed in any number of ways across a control 
network. In the exemplary embodiment shown in Figure 9, each trigger 
function is associated with trigger criteria and trigger control commands. 
For example, the first trigger function is speech recognition 600. If a 
participant station (or the automatic bridge controller) enables the speech- 
recognition function, the bridge analyzer 412 analyzes the media flows from 
the participants and searches for trigger criteria in the form of key words (or 
phonemes) 601 . When those key words are detected, the bridge analyzer 
issues appropriate trigger control command(s) 602. In this example, the 
trigger control command may include switching a participant station to a 
different conference, muting a particular participant station from the input to 
another participant station's media flow, or any other appropriate commands 
depending on the particular algorithm employed. Similarly, other trigger 
functions such as object collision detection 610 (with associated trigger 
criteria 61 1 and trigger control commands 612) and participant attribute 
monitoring 620 (with associated trigger criteria 621 and trigger control 
commands 622) can be effected by the bridge analyzer 412. These have 
been discussed in greater detail in relation to Figures 4-6. 

The trigger criteria and trigger control commands associated with a 
particular trigger function may be set or altered dynamically in accordance 
with the present invention either centrally and/or at the participant stations 
(e.g., 1 10). Moreover, not all trigger functions are necessarily enabled for 
all participant stations. For example, each participant station preferably 
enters participant profile information when it first establishes a connection 
to the conference bridging unit 410, 420. This participant profile 
information may include personal participant information (e.g., gender, age, 
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location, etc.), specific trigger criteria (e.g., scan for conversations 
mentioning the word "sports"), trigger function enable/disable preferences 
(e.g., enable parental control function filtering out age-inappropriate 
language), etc. This participant profile information can be manually 
entered, stored by the participant station from a previous conference and 
resent to the conference bridging unit, and/or stored at the conference 
bridging unit or elsewhere. In each case, the participant profile is 
preferably communicated at the initiation of a session to the corresponding 
automatic bridge controller, and is temporarily linked via the trigger 
definition database to participant option field settings, allowing testing of 
particular functions for each participant. 

The participant profile information can then be used to adapt the 
trigger definition database to the particular needs of that participant station. 
Alternatively, the media flow from each participant station may include 
explicit commands to the bridge analyzer to enable certain functions or 
change trigger criteria or trigger control commands. In another embodiment, 
the system may set the trigger functions, criteria, and control commands. 
For example, in a conference dedicated to the discussion of children's 
books, the present system may automatically disconnect from the conference 
any user who utters a vulgarity. 

For example, a participant who is a young girl may choose (or her 
parents may choose) to enable the speech recognition function, including 
trigger criteria comprising a set of offensive words, and including a control 
command that mutes the offensive speaker from the young girl's input audio 
stream. An adult participant, alternatively, may disable the speech 
recognition function or use it differently. For example, an adult looking for 
a conversation about sports, may enable the speech recognition function, 
including trigger criteria comprising a few sports terms, and a trigger control 
command to connect him/her to that conversation. In a virtual chat room 
environment, such as described in related U.S. Application No. 09/xxx,xxx, 
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entitled "Teleconference Bridge with Edgepoint Mixing," previously 
incorporated by reference herein, this may comprise repositioning that 
participant's avatar near the conversation of interest. In another 
embodiment, this function may include monitoring media streams from 
5 participants connected to other conference bridging units and rerouting the 

participant station to that conference bridging unit if a conversation of 
interest is found. 

While the invention has been described in terms of a single preferred 
embodiment, those skilled in the art will recognize that the invention can be 
10 practiced with modification within the spirit and scope of the appended 
claims. 
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CLAIMS 



Having thus described our invention, what we claim as new and 
desire to secure by Letters Patent is as follows: 



1 1 . A system for automatically controlling a teleconference, comprising: 

2 means for establishing a trigger definition database in accordance 

3 with participant configuration profiles, there being a participant 

4 configuration profile for each of a plurality of endpoints connected to said 

5 teleconference through a media bridge; 

6 means for analyzing media flows to identify trigger criteria defined 

7 in said trigger definition database, said media flows originating from an 

8 endpoint for distribution through said media bridge to other endpoints on 

9 said teleconference; 

1 0 means for generating conference control commands, in accordance 

1 1 with said trigger definition database, when said trigger criteria are identified 

12 by said analysis. 

1 2. The system of claim 1 , wherein said analyzing means is a bridge 

2 analyzer. 

1 3. The system claim 2, wherein said bridge analyzer is located within an 

2 automatic bridge controller on a network. 

1 4. The method of claim 2, wherein said bridge analyzer is located in part at 

2 an automatic bridge controller and in part at an endpoint, in accordance with 

3 design criteria for operation of a network of one or more of said 

4 teleconferences. 
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1 5. The method of claim 4, wherein said trigger criteria include speech 

2 recognition of media flow from an endpoint and wherein said conference 

3 control commands include switching said endpoint to another teleconference 

4 on said network. 

1 6. The system of claim 1 , wherein said trigger criteria include collision 

2 detection and wherein said conference control commands include changing 

3 background music at an endpoint responsive to said collision detection. 

1 7. The system of claim 1, wherein said trigger criteria include participant 

2 attribute change and wherein said conference control commands include 

3 invoking real time translation of media flows distributed to said participant. 

1 8. The system of claim 1, wherein said participant configuration profile is 

2 modifiable during said teleconference. 

1 9. The system of claim 1 , wherein said analyzing means further comprises: 

2 means for associating a media flow with an endpoint; 

3 means for using said trigger definition database to determine trigger 

4 criteria applicable to said endpoint; 

5 means for applying said determined trigger criteria to said media 

6 flow. 

1 1 0. The system of claim 9, wherein said generating means further 

2 comprises: 

3 means for receiving an identification of trigger criteria from said 

4 analyzing means; 

5 means for using said trigger definition database to determine 

6 conference control commands applicable to said trigger criteria; 

7 means for issuing said conference control commands. 
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1 1 1 . A method for automatically controlling a teleconference, comprising the 

2 steps of: 

3 establishing a trigger definition database in accordance with 

4 participant configuration profiles, there being a participant configuration 

5 profile for each of a plurality of endpoints connected to said teleconference 

6 through a media bridge; 

7 analyzing media flows to identify trigger criteria defined in said 

8 trigger definition database, said media flows originating from an endpoint 

9 for distribution through said media bridge to other endpoints on said 

10 teleconference; 

1 1 generating conference control commands, in accordance with said 

12 trigger definition database, when said trigger criteria are identified by said 

13 analysis. 

1 12. The method of claim 1 1 , wherein said analyzing step is performed by a 

2 bridge analyzer. 

1 13. The method of claim 12, wherein said bridge analyzer is located within 

2 an automatic bridge controller on a network. 

1 14. The method of claim 12, wherein said bridge analyzer is located in part 

2 at an automatic bridge controller and in part at an endpoint, in accordance 

3 with design criteria for operation of a network of one or more of said 

4 teleconferences. 

1 1 5. The method of claim 14, wherein said trigger criteria include speech 

2 recognition of media flow from an endpoint and wherein said conference 

3 control commands include switching said endpoint to another teleconference 

4 on said network. 
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1 1 6. The method of claim 1 1 , wherein said trigger criteria include collision 

2 detection and wherein said conference control commands include changing 

3 background music at an endpoint responsive to said collision detection. 

1 1 7. The method of claim 1 1 , wherein said trigger criteria include participant 

2 attribute change and wherein said conference control commands include 

3 invoking real time translation of media flows distributed to said participant. 

1 1 8. The method of claim 1 1, wherein said participant configuration profile 

2 is modifiable during said teleconference. 

1 1 9. The method of claim 1 1 , wherein said analyzing step further comprises 

2 the steps of: 

3 associating a media flow with an endpoint; 

4 using said trigger definition database to determine trigger criteria 

5 applicable to said endpoint; 

6 applying said determined trigger criteria to said media flow. 

1 20. The method of claim 19, wherein said generating step further comprises 

2 the steps of: 

3 receiving an identification of trigger criteria from said analyzing 

4 step; 

5 using said trigger definition database to determine conference control 

6 commands applicable to said trigger criteria; 

7 issuing said conference control commands. 

1 2 1 . A system for automatically controlling a conference, wherein a plurality 

2 of participant stations, including at least a first participant station, are 

3 operatively connected by a media bridge, the system comprising: 
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4 a trigger definition database, including trigger criteria and trigger 

5 control commands associated with trigger functions; 

6 at least a first bridge analyzer, operatively connected to the trigger 

7 definition database and the media bridge, adapted to: 

8 analyze media flow from at least the first participant station to the 

9 media bridge; 

1 0 implement at least a first of the trigger functions identified in the 

11 trigger database; 

1 2 identify whether at least a first of the trigger criteria for the first 

1 3 trigger function are satisfied by the media flow; and 

1 4 generate at least a first control command when the first trigger 

1 5 criteria is satisfied. 

1 22. The system of claim 2 1 , wherein at least part of the first bridge analyzer 

2 is located within an automatic bridge controller on a network. 

1 23. The system of claim 21, wherein the first bridge analyzer is located in 

2 part at an automatic bridge controller and in part at one of the plurality of 

3 participant stations. 

1 24. The system of claim 23, wherein the first trigger function includes 

2 speech recognition and the trigger criteria include key words in the media 

3 flow from a second of the participant stations and wherein said conference 

4 control commands include switching the first participant station to another 

5 teleconference on said network. 



1 
2 
3 



25. The system of claim 23, wherein the first trigger function includes 
speech recognition and the trigger criteria include key words in the media 
flow from the first participant station and wherein the conference control 
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4 commands include switching the first participant station to another 

5 teleconference on the network. 

1 26. The system of claim 2 1 , wherein said first trigger function includes 

2 collision detection, the trigger criteria include intersection of objects, and 

3 wherein the control commands include causing an audible event at the first 

4 participant station responsive to said collision detection. 

1 27. The system of claim 26, wherein the audible event is a change in 

2 conference background music at the first participant station. 

1 28. The system of claim 21 , wherein the first trigger function includes 

2 attribute monitoring, the trigger criteria include participant attribute change 

3 and wherein said conference control commands include invoking real time 

4 translation of media flows distributed to the first participant station. 

1 29. The system of claim 2 1 , wherein the trigger database includes at least a 

2 first profile for at least the first participant station and the first profile is 

3 modifiable during the conference. 

1 30. The system of claim 21, further comprising a second bridge analyzer, 

2 operatively connected to the media bridge and the trigger database. 

1 31. The system of claim 30, wherein the first bridge analyzer is located on 

2 an automatic bridge controller on a network and the second bridge analyzer 

3 is locate on the first participant station. 

1 32. A method for automatically controlling a conference, wherein a 

2 plurality of participant stations, including at least a first participant station, 

3 are operatively connected by a media bridge and the media bridge is 
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operatively connected to a trigger definition database, including trigger 
criteria and trigger control commands associated with trigger functions, the 
method comprising the steps of: 

analyzing media flow from at least the first participant station to the 
media bridge; 

implementing at least a first of the trigger functions identified in the 
trigger database; 

identifying whether at least a first of the trigger criteria for the first 
trigger function are satisfied by the media flow; and 

generating at least a first control command when the first trigger 
criteria is satisfied. 

33. The method of claim 32, wherein the first trigger function includes 
speech recognition and the trigger criteria include key words in the media 
flow from a second of the participant stations and wherein said conference 
control commands include switching the first participant station to another 
conference. 

34. The method of claim 32, wherein the first trigger function includes 
speech recognition and the trigger criteria include key words in the media 
flow from the first participant station and wherein the conference control 
commands include switching the first participant station to another 
teleconference. 

35. The method of claim 32, wherein said first trigger function includes 
collision detection, the trigger criteria include intersection of objects, and 
wherein the control commands include causing an audible event at the first 
participant station responsive to said collision detection. 

36 The method of claim 35, wherein the audible event is a change in 
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conference background music at the first participant station. 

37. The method of claim 32, wherein the first trigger function includes 
attribute monitoring, the trigger criteria include participant attribute change 
and wherein said conference control commands include invoking real time 
translation of media flows distributed to the first participant station. 

38. The method of claim 31, wherein the trigger database includes at least a 
first profile for at least the first participant station and the first profile is 
modifiable during the conference. 

39. A computer-readable medium containing instructions for controlling a 
computer system to facilitate a conference process among a plurality of 
participant stations, including at least a first participant stations, wherein the 
participant stations are operatively connected to a media bridge and the 
media bridge is operatively connected to a trigger definition database, 
including trigger criteria and trigger control commands associated with 
trigger functions, the process comprising: 

analyzing media flow from at least the first participant station to the 
media bridge; 

implementing at least a first of the trigger functions identified in the 
trigger database; 

identifying whether at least a first of the trigger criteria for the first 
trigger function are satisfied by the media flow; and 

generating at least a first control command when the first trigger 
criteria is satisfied. 

40. An automatic teleconferencing control system comprising: 

a plurality of media conferencing bridges on a network, each said 
media bridge controlling a conference among a plurality of participant 
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4 stations, each said participant station being connected to one of said media 

5 bridges at a time; 

6 at least one automatic bridge controller, said automatic bridge 

7 controller further comprising a trigger definition database and a bridge 

8 analyzer; 

9 wherein media flows are generated at a participant station and are 

1 0 communicated through said automatic bridge controller to other participant 

1 1 stations on said conference; and 

12 wherein said automatic bridge controller uses said trigger definition 

1 3 database to control said media flow in accordance with participant 
1 A configuration profiles at each said participant station. 
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